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I.  THE  PROBLEMS  STUDIED 


The  objectives  of  the  research  were  to  study  direct  and  iterative  methods 
for  approximating  solutions  to  systems  of  linear  equations  Ax  = b,  where  the 
coefficient  matrix  A is  singular  or  in  general  rectangular.  Such  problems 
arise  in  geodesy  calculations,  in  finite  difference  and  finite  element  methods 
for  approximating  solutions  to  certin  types  of  partial  differential  equations 
such  as  the  Neumann  problem  or  Poisson's  equation  on  a sphere,  in  statisitical 
calculations,  in  structural  analysis  and  in  Markov  analysis. 

Direct  and  iterative  methods  were  to  be  investigated.  Direct  algorithms 
for  obtaining  minimal  I2  ~ solutions  to  consistent  rectangular  systems  of 
linear  equations  were  to  be  developed  and  compared  numerically.  The  primary 
emphasis  of  the  research  was  to  be  placed  iterative  methods  and  the  case  where 
the  coefficient  matrix  A of  the  system  is  large  and  sparse.  Both  the  con- 
sistent and  the  inconsistent  cases  were  to  be  investigated  here.  In  the  con- 
sistent case,  special  emphasis  was  to  be  placed  upon  certain  types  of  matrices 
A,  such  as  M-matrices,  that  comnonly  arise  in  these  applications.  Finally,  the 
inconsistent  case  was  to  be  studied  with  the  purpose  of  developing  an  SOR 
type  iterative  method  for  large  sparse  linear  least  squares  problems. 


II.  SUMMARY  OF  THE  MOST  IMPORTANT  RESULTS 


The  most  important  research  accomplishments  by  the  principal  investigator 
are  as  follows: 

1.  Minimum  ~ Solutions  to  Rectangular  Systems  of  Linear  Equations. 

This  joint  research,  with  R.  E.  Cline,  involved  the  development  and 
testing  of  some  new  algorithms  for  using  various  combinations  of  ortho- 
ginal  decomposition  methods  and  elimination  methods  for  computing  solu- 
tions to  Ax  = b,  minimal  with  respect  to  the  Euclidean  norm.  Some 
new  techniques  were  designed,  implemented  on  the  computer  and  were  com- 
pared with  existing  techniques.  Growing  out  of  this  research  was  a 28 
page  paper  in  the  SIAM  Review. 

2.  Iterative  Methods  for  Consistent  Linear  Systems.  This  research  involved 
the  investigations  of  iterative  methods  for  approximating  solutions  to 
consistent  systems,  based  upon  various spl i ttings  of  A into  A = M - N 
with  M nonsingular.  Particular  attention  was  given  to  the  study  of  the 
convergence  of  such  methods  and  upon  extending  the  usual  linear  station- 
ary iterative  methods,  such  as  the  SOR  method,  to  the  singular  case. 

Some  new  convergence  results  were  obtained  and  five  papers  were  published 

^ on  this  subject,  some  with  joint  authors  C.  Meyer,  M.  Neumann  andj.  Ortega. 
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I 3.  M-matrices  and  Related  Topics.  The  investigation  of  iterative  methods 

for  consistent  linear  systems  led  in  a natural  way  to  the  study  of  the 
n properties  of  some  important  classes  of  matrices.  Particular  attention 

:|  was  given  to  the  roles  of  matrix  monotonicity  and  nonnegative  matrices 

i|  in  the  mathematical  sciences.  Some  of  the  major  results  of  this  research 

were  (1)  characterizations  of  various  types  of  matrix  monotonicity  and 
1 their  relationships  to  monotone  iterations,  (2)  a solution  of  the  classi- 

cal  problem  of  characterizing  in  a useful  way  the  diagonal  stability 
of  a real,  square  matrix  and  (3)  the  collection  and  classification  of 


40  characterizations  of  nonsingular  M-matrices.  Five  papers  or  reports  were 
written  on  these  subjects,  some  with  joint  authors  G.  Barker,  A.  Berman 
and  M Neumann, 

4.  Block  SOR  Type  Methods  for  Certain  Large  Sparse  Linear  Least  Squares  Pro- 
blems. One  of  the  primary  research  contributions  under  this  contract 
was  the  investigation  of  block  iterative  methods  for  solving  the  large 
sparse  linear  least  squares  problem 

mini |b  - Ax| I2 

X 

where  A has  full  column  rank  and  has  been  permuted  into  the  form 


A = 


, A-|  nonsingular. 


It  has  been  shown  that  a block  SOR  type  iterative  method  is  both  feasible 
and  practical  whenever 

A^Ai  - A^A^ 


is  positive  definite.  The  method  is  especially  attractive  for  solving  the 
linear  least  squares  problem  with  equality  constraints.  Methods  for  ap- 
proximating the  optimum  SOR  relaxation  parameter  (which  is  shown  to  lie  in 
the  interval  (.9,1]  were  obtained,  thus  extending  some  earlier  work  of  Chen 
and  Gentleman.  A preliminary  report  on  this  work  has  been  written  with 
G.  Melendez  and  research  is  continuing  on  this  project. 

The  principal  investigator  feels  that  the  majority  of  the  research  objec- 
tives of  this  three  year  contract  have  been  met  and  that  the  overall  results 
will  provide  useful  tools  for  U.S.  Army  Researchers  and  others  working  in  these 
areas. 

No  scientific  personnel  other  than  the  principal  investigator  was  employed 


on  this  contract. 
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